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1 28.06.2002 
Spatial Scalable Compression Scheme Using Adaptive Content Filtering 



FIELD OF THE INVENTION 

The invention relates to a video encoder/decoder, and more particularly to a 
video encoder/decoder with spatial scalable compression schemes using adaptive content 
filtering Or dynamic resolution. 

5 

BACKGROUND OF THE INVENTION 

Because of the massive amounts of data inherent in digital video, the 
transmission of full-motion, high-definition digital video signals is a significant problem in 
the development of high-definition television, More particularly, each digital image frame is 

10 a still image formed from an array of pixels according to the display resolution of a particular 
system- As a result, the amounts of raw digital information included in high-resolution video 
sequences are massive. In order to reduce the amount of data that must be sent, compression 
schemes are used to compress the data. Various video compression standards or processes 
have been established, including, MPEG-2, MPEG-4, and H.263. 

1 5 Many applications are enabled where video is available at various resolutions 

and/or qualities in one stream, Methods to accomplish this are loosely referred to as 
scalability techniques. There are three axes on which one can deploy scalability. The first is 
scalability on the time axis, often refeiTed to as temporal scalability. Secondly, there is 
scalability on the quality axis (quantization), often referred to as signal-to-noise (SNR) 

20 scalability or fine-grain scalability. Hie third axis is the resolution axis (number of pixels in 
image) often refeired to as spatial scalability. In layered coding, the bitstream is divided into 
two or more hitstreams, or layers* Each layer can be combined to form a single high quality 
signal. For example, the base layer may provide a lower quality video signal, while the 
enhancement layer provides additional information that can enhance the base layer image. 

25 In particular, spatial scalability can provide compatibility between different 

video standards or decoder capabilities, With spatial scalability, the base layer video may 
have a lower resolution than the input video sequence, in which case the enhancement layer 
carries information which can restore the resolution of the base layer to the input sequence 
level. 
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2 28.06.2002 
Figure 1 illustrates a known spatial scalable video encoder 100. The depicted 
encoding system 100 accomplishes layer compression, whereby a portion of the channel is 
used for providing a low resolution base layer and the remaining portion is used for 
transmitting edge enhancement information, whereby the two signals may be recombined to 
5 bring the system up to high^esolufion. The high resolution video input is split by splitter 102 
whereby the data is sent to a low pass filter 104 and a subtraction circuit 106. The low pass 
filter 104 reduces the resolution of the video date, which is then fed to a base encoder 108. In 
general, low pass filters and encoders are well known in the art and are not described in detail 
herein for purposes of simplicity. The encoder 108 produces a lower resolution base stream 

1 0 which can be broadcast, received and via a decoder, displayed as is, although the base stream 
does not provide a resolution which would be considered as high-definition. 

The output of the encoder 108 is also fed to a decoder 1 12 within the system 
100- From there, the decoded signal is fed into an interpolate and upsample circuit 1 14. In 
general, the interpolate and upsample circuit 1 14 reconstructs the filtered out resolution from 

15 the decoded video stream and provides a video data stream having the same resolution as the 
high-resolution input, However, because of the filtering and the losses resulting from the 
encoding and decoding, loss of information is present in the reconstructed stream. The loss is 
determined in the subtraction circuit 106 by subtracting the reconstructed high-resolution 
stream from the original, unmodified high-resolution stream. The output of the subtraction 

20 circuit 1 06 is fed to an enhancement encoder 116 which outputs a reasonable quality 
enhancement stream. 

Although these layered compression schemes can be made to work quite well, 
these schemes still have a problem in that the enhancement layer needs a high bitrate. 
Normally, the bitrate of the enhancement layer is equal to or higher than the bitrate of the 

25 base layer. However, the desire to store high definition video signals calls for lower bitrates 
than can normally be delivered by common compression standards. This can make it 
difficult to introduce high definition on existing standard definition systems> because the 
recording/playing time becomes too small 

30 SUMMARY OP THE INVENTION 

The invention overcomes the deficiencies of other known layered compression 
schemes by using adaptive content filtering to reduce the number of bits in the residual signal 

inputted into ibs enhancement encoder., thereby lowering the hitrats of tha enhanc ement 
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According to one embodiment of the invention, a method and apparatus for 
providing spatial scalable compression using adaptive content filtering of a video stream is 
disclosed. The video stream is downsampled to reduoe the resolution of the video stream. 
The downsampled video stream is then encoded to produce a base stream. The base stream is 
5 upconverted to produce a reconstructed video stream. The video stream and the 

reconstructed video stream are then analyzed to produce a gain value of the content of each 
pixel or group of pixels in the frames of the received video streams. The reconstructed video 
stream is subtracted from me video stream to produce a residual stream. The residual stream 
is attenuated by a multiplier with a variable gain factor so as to remove bits from the residual 
10 stream which represent areas of each frame which have little detail. The resulting residual 
stream is then encoded and oulpumng an enhancement stream- 
According to another embodiment of the invention, the gain value of the 
attenuator outoutted from the picture analyzer can be combined with the normal bitrate 
control from the enhancement encoder so as to allow for coding a variable overall resolution 
1 5 depending on the available bitrate budget of the enhancement encoder. 

According to another embedment of the invention, a method and apparatus 
relating to sharpness control in the decoder is disclosed. The base stream is decoded and men 
upconverted to increase the resolution of the decoded base stream. The enhancement stream 
is decoded and then multiplied by a shaipness control value, wherein the sharpness control 
value controls me trade-off between sharpness and the visibility of artifacts in the decoded 
enhancement stream. Finally, the upconverted decoded base stream is combined with the 
sharpness controlled enhancement stream to produce a video output. 
These and other aspects of the invention will be apparent from and elucidated with reference 
to the embodiments described hereafter. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will now be described, by way of example, with reference to the 
accompanying drawings, wherein: 

Figure 1 is a block diagram representing a known layered video encoder; 

Figure 2 is a block diagram of a layered video encoder/decoder according to 
an embodiment of the invention; 

Figure 3 is a block diagram of a layered video encoder/decoder according to 
an embodiment of the invention; 
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Figure 4 is a block diagram of a layered video decoder according to an 
embodiment of the invention; 

Figure 5 Is a block diagram of a layered video encoder and layered video 
decoders according to a further embodiment of the invention; and 
5 Figure 6 shows a block diagram of a further advantageous embodiment of the 

invention. 

f 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 2 is a block diagram of a layered video encoder/decoder 200 according 
10 to one embodiment of the invention. The encoder/decoder 200 comprises an encoding 
section 201 + 203 and a decoding section 205. A Wgh-resolutlon video stream 202 is 
inputted into the base encoding section 201 . The video stream 202 is then split by a splitter 
204, whereby the video stream is sent to a low pass filter 206 and a second splitter 21 1 . The 
low pass filter or downsampling unit 206 reduce? the resolution of the video stream, which is 
15 then fed to abase encoder 208. The base encoder 208 encodes the downsampled video 
stream in a known manner and outputs a base stream 209. In this embodiment, the base 
encoder 208 outputs a local decoder output to an upconverting unit 210. The upconverting 
unit 210 reconstructs the filtered out resolution from the local decoded video stream and 
provides a reconstructed video stream having basically the same resolution format as the 
20 high-resolution input video stream in a known manner. Alternatively, the base encoder 208 
may output an encoded output to the upconverting unit 21 0, wherein either a separate 
decoder (not illustrated) or a decoder provided in the upconverting unit 210 will have to first 
decode the encoded signal before it is upconverted. 

The splitter 21 1 splits the high-resolution input video stream, whereby the 
25 input video stream 202 is sent to a subtraction unit 212 and a picture analyzer 214* In 

addition, the reconstructed video stream is also inputted into the picture analyzer 214 and the 
subtraction unit 212, The picture analyzer 214 analyzes the frames of the input stream and/or 
the frames of the reconstructed video stream and produces a numerical gain value of the 
content of each pixel or group of pixels in each frame of the video stream. The numerical 
30 gain value is comprised of the location of the pixel or group of pixels given by, for example, 
the x,y coordinates of the pixel or group of pixels in a frame, the frame number, and a gain 
value. When the pi&el or group of pixels has a lot of detail, the gain value moves toward a 
l irdu* of "I 53 . Lifoswiss, whoa the pixel or group of pixels doss not hnire much 
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criteria for the picture analyzer are described below, but the invention is not Umited to these 
examples. First, the picture analyzer can analyze the local spread around the pixel versus the 
average pixel spread over the whole frame. The picture analyzer could also analyze the edge 
level, e.g., abs of 

*1 -1 -1 
-1 8 -1 
-1 -1 -1 

per pixel divided over average value over whole frame. 

The gain values for varying degrees of detail can be predetennined and stored 
in a look-up table for recall once the level of detail for each pixel or group of pixels is 
determined. 

As mentioned above, the reconstructed video stream and the high-resolution 
input video stream are inputted into Hie subtraction unit 212. The subtraction unit 212 
subtracts the reconstructed video stream from the input video stream to produce a residual 
stream. The gain values from the picture analyzer 214 are sent to a multipHer 216 which is 
used to control the attenuation of the residual stream. In an alternative embodiment, the 
picture analyzer 214 can be removed from the system and predeterrnined gain values can be 
loaded into the multipHer 216. Alternatively, gain values can be entered by a user mannaUy 
using, for example, a control knob (not illuslrated). The effect of multiplying the residual 
stream by the gain values is that a kind of filtering takes place for areas of each frame that 
have little detail. In such areas, normally a lot of bits would have to be spent on mostly 
irrelevant little details or noise. But by multiplying the residual stream by gain values which 
move toward zero for areas of little or no detail, these bits can be removed from the residual 
stream before being encoded in the enhancement encoder 218. Likewise, the multiplier will 
move toward one for edges and/or text areas and only those areas will be encoded . The 
effect on normal pictures can be a large saving on bits. Although the quality of the video will 
be effected somewhat, in relation to the savings of the bitrate, tins is a good compromise 
especially when compared to normal compression techniques at the same overall bitrate. The 
output from the multiplier 216 is inputted into the enhancement encoder 21 8 which produces 
an enhancement stream. 

In the decoder section 205, the base stream is decoded in a known manner by a 
decoder 220 and the enhancement stream is decoded in a known manner by a decoder 222. 
The decoded base stream is then upconverted in an upconverting unit 224. The upconverted 
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base stream and the decoded enhancement stream are then combined in an arithmetic unit 
226 to produce an output video stream 228. 

Figure 3 illustrates an encoder/decoder 300 according to one embodiment of 
the invention. In this embodiment, the gain value sent to the multiplier is controlled by the 
5 available bitrate budget of the enhancement encoder. The bitrate control of the enhancement 
encoder can be extended by combining the gain values from the picture analyzer 214 with 
encoder statistics parameters from the enhancement encoder to produce final gain control 
parameters which are multiplied with the residual stream, The encoder/decoder 300 has all 
of the described elements of Figure 2 which have been given like numbers in Figure 3. For 
1 0 simplicity, the operations of the like elements will not be described herein. 

In addition, the encoder/decoder 300 has a combination unit 215 located 
between the picture analyzer 214 and the multiplier 216. The combination unit 215 receives 
the gain value from the picture analyzer 214. In addition, the combination unit 21 5 receives 
enhancement parameters based on encoder statistics from the enhancement encoder 21 S. The 
15 combination unit 215 combines the encoder statistics parameters and the gain values and 
outputs final gain control parameters to the multiplier 216* The residual stream is then 
multiplied by the final gain control parameters before being encoded by the enhancement 
encoder 21 8. In other words, the gain values from the picture analyzer 21 4 are adjusted up or 
down depending on the available bitrate of the enhancement encoder. If the enhancement 
20 encode* has a small available bitrate budgets the gain values will be adjusted downward so 
that more bits will be filtered out of the residual stream. Likewise, if the enhancement 
encoder has a large available bitrate budget, the gain values will be adjusted upwards so that 
less bits will be filtered out of the residual stream. Thus, when the encoder statistics 
parameter indicates that the available bitrate budget is no longer sufficient for encoding at 
25 full resolution with sufficient quality* the gain of the multiplier 216 is set to a reduced 
resolution value in order to meet the available bitrate budget. This allows for coding a 
variable overall resolution depending on the available bitrate budget. 

Figure 4 illustrates a decoder 400 according to one embodiment of the 
invention. In Figure 4, the decoder 400 has a sharpness control unit 230 and a multiplier 232 
30 added to the decoder section 205> The sharpness control unit 230 allows the user to select a 
parameter between 0 and 1 wherein the lower the number leads to a greater reduction in the 
number of visible artifacts in the output video stream 228 and the higher the number leads to 
a sharper image of the- output video stream 228. Thus, the ahsspness control unit controls the 
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selected sharpness control parameter is inputted into Ihe multipHer 232. The multiplier 232 
fcen multiplies the decoded enhancement stream by the sharpness control parameter to adjust 
the sharpness and visibility of artifacts in the enhancement stream prior to combining the 
enhancement stream with the upconverted base stream in the arithmetic unit 226. 

Figure 5 shows a block diagram of a layered video encoder 503, the layered 
video decoder 205 and a layered video decoder 505. The video encoder 503 includes a 
subtracter 510 and a second enhancement encoder 511 added to the video encoder 203 The 
video encoder 503 can straightforwardly be enhanced with the combination unit 215 as 
shown in Figure 3. Figures 2 and 3 show the use of a multiplier 216 to influence the input to 
the enhancement encoder 21 8 in order to provide adaptation of the enhancement layer A 
disadvantage of the enhancement encoding shown in Figures 2 and 3 is that some picture 
details are lost and cannot be regenerated anymore because the multiplier operation of 
multiplier 216 is irreversible. The encoder 503 overcomes mis problem by providing a 
second enhancement layer provided by subtracter 510 and enhancement encoder 51 1, which 
second enhancement layer represents the details lost in the mulitplier 21 6. In fact, the second 
enhancement encoder 511 encodes the difference between the input and the output of 

mputs. For example, if present, a variable length encoding can be optimized for the statistics 
of the respective signals. 

Thesignalproducedbytheencoder201 + 503 can be decoded by flie decoder 
205 as described hereinbefore. M that case only the base layer and the first enhancement 
layer are decoded. 

To decode the second enhancement layer, decoder 505 is provided which 
includes a decoder 5 12 for me second enhancement layer and an adder 5 1 3 in addition to the 
decoder 205. The enhancement layer decoded in decoder 512 is in this embodiment simply 
added to the output stream of me decoder 205 in order to provide a transparent video 
resolution in the sense that the resolution of the decoded stream is now similar to the 
resolution of the input 202. 

Figure 6 shows a further advantageous embodiment of the invention which 
relates to the embodiment of Figure 2 although the teachings of the embodiment according to 
Figure 6 may also be combined with other embodiments of the invention. Instead of picture 
analyzer 214 at least two picture analyzers are provided. A possible combination is shown in 
Figure 6 which shows a, preferably pixel-based, detail metric based analyzer 614 in 
combination with at least another analyzer which is based on another metric such as a skin- 
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tone metric or a natural vegetation metric. Examples of these metrics are as such, well-know 
in the art Experiments showed that such a combination works well because people and 
especially their feces are tracked and encoded at a higher bit-rate. This is advantageous 
because the human eye is attracted by other humans and especially their faces. A detail- 
5 metric based analyzer is normally not very excited by subtle details of feces, so normally the 
alpha gain will still be relatively high for faces which will then be encoded in fee lower base 
resolution. By introducing the skin tone metric and/or natural vegetation metric fee 
perception effaces can be improved by adapting fee alpha towards zero which means higher 
resolution and details. Alternatively or in addition to such combination, depth and 
10 segmentation information is used to achieve a better adaptation to the human viewing 

behavior. Depth and segmentation infoimation may be available in the bit-stream or may be 
derived locally. Objects on fee foreground of a scene are often more important and more 
likely to be tracked by the viewers than smaller objects in the distance or background 
scenery. So, this depth and segmentation irrfhrrrtation can be used to bias the aplha towards 
15 zero for foreground objects. By combining fee depth wife motion information the 

segmentation can be performed more easily. The motion information can be obtained from 
the motion estimator in the base encoder 208 and/or enhancement encoder 218. In particular 
the combination of a detail-metric based picture analyzer, a skin tone metric based picture 
analyzer and the use of depth and segmentation information is advantageous because fee 
20 human eye is often attracted by other humans which are in fee foreground of fee image or 
video. The blocks 614...619 can be interpreted as a substitute for but also as an advantageous 
implementation of picture analyzer 214. 

The above-described embodiments of the invention enhance the efficiency of 
known spatial scalable compression schemes by lowering the bitrate of fee enhancement 
25 layer by using adaptive content filtering to remove unnecessary bits from fee residual stream 
prior to encoding. It will be understood feat the different embodiments of fee invention are 
not limited to fee exact order of fee above-described steps as fee timing of some steps can be 
interchanged without affecting fee overall operation of fee invention. Furthermore, fee term 
"comprising" does not exclude other elements or steps, fee terms "a" and <W* do not exclude 
30 a plurality and a single processor or other unit may fulfill fee functions of several of the units 
or circuits recited in the claims. 
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CLAIMS: 



1 . An apparatus for efficiently performing spatial scalable compression of video 

information captured in a plurality of frames including an encoder for encoding and 
outputting the captured video frames into a compressed data stream, comprising: 

a base layer comprising an encoded bitstream having a relatively low 

resolution; 

a high resolution enhancement layer comprising a residual signal having a 
relatively higjs resolution; and 

■wherein a multiplier unit attenuates the residual signal, the residual signal 
being the difference between original frames and upscaled frames from the base layer, so as 
to reduce the number of bits needed. 

2. The apparatus for efficiently performing spatial scalable compression of video 
information according to claim 1, wherein the multiplier attenuates the residual signal by a 
predetermined amount. 

3. The apparatus for efficiently performing spatial scalable compression of video 
information accordingto claim 1, whereinthe amount of attenuation can be manually, 
changed by a control knob. 

4. The apparatus for efficiently performing spatial scalable compression of video 
hiformation according to claim l s further comprising: 

a picture analyzer which receives upscale and/or original frames and calculates a gain value 
of the content of each pixel in each received frame, wherein the multiplier uses the gain value 
to attenuate the residual signal. 



5. The apparatus for efficiently perfonning spatial scalable compression of video 

information according to claim 4, wherein the gain value goes toward zero for areas oflittle 
detail. 
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5 4 The apparatus for efficiently performing spatial scalable compression of video 

infonnation according to claim 4, wherein the gain value goes toward one for edges and text 
areas, 

5 7 § The apparatus for efficiently performing spatial scalable compression of video 

information according to claim 4, wherein the gain value is calculated for a group of pixels. 

8. A layered encoder for encoding and decoding a video stream, comprising; 

a downsampling unit for reducing the resolution of the video stream; 
10 a base encoder for encoding a lower resolution base stream; 

an upconverting unit for decoding and increasing the resolution of the base 
stream to produce a reconstructed video stream; 

a subtracter unit for subtracting the reconstructed video stream from the 
original video stream to produce a residual signal; 
IS a first multiplier unit which multiplies the residual signal by gain values so as 

to remove bits from the residual signal for areas which have little detail; 

an enhancement encoder for encoding the resulting residual signal from the 
multiplier and outputting an enhancement stream. 

20 9. The layered encoder according to olaim 8, wherein the multiplier attenuates 

the residual signal by a predetermined amount. 

10. The layered encoder according to claim 8, wherein the amount of attenuation 

can be manually changed by a control knob, 

25 

X 1 „ The layered encoder according to claim S 5 further comprising: 

a picture analyzer which receives the video stream and Ihe reconstructed video stream and 

calculates the gain values of the content of each pixel in each frame of the received streams. 

30 12, The layered encoder according to claim 11, wherein the gain value goes 

toward zero for areas of little detail, 



13. 



Ths layered sncodssi according to clmm 1 1. vyLfflsdo. the g-sin value goes 
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14. The layered encoder according to claim 11, further comprising: 
a traditional bitrate control combined with bitrate control via the first 

multiplier unit; and 

a combiner located between the picture analyzer and the first multiplier unit 
for combining the gain value with encoder statistic parameters from the enhancement encoder 
and outputting the combined gain value to the first multiplier unit 

15. The layered encoder according to claim 14, wherein the encoder statistics 
10 parameters indicate when the available bitrate budget is no longer sufficient for encoding at 

full resolution of sufficient quality, so that me gain of the first multiplier unit is set to a 
reduced resolution value in order to meet the available bitrate budget 

16. The layered encoder according to claim 1 1, wherein the gain value is 
1 5 calculated for a group of pixels. 

17. A decoder for decoding compressed video infonnation, comprising: 
a base stream decoder for decoding a received base stream; 

an upconverting unit for increasing the resolution of the of the decoded base 

20 stream; 

an enhancement stream decoder for decoding a received enhancement stream; 
a sharpness control means for outputting a sharpness control value; 
a second muliplier unit for multiplying the decoded enhancement stream by 
the sharpness control value so as to allow a user to control the tradeoff between sharpness 
25 and the visibility of artifacts in the decoded enhancement stream; and 

an addition unit for combining the upconverted decoded base stream and the 
sharpness controlled enhancement stream to produce a video output 

1 8. A method for providing spatial scalable compression using adaptive content 

30 filtering of a video stream, comprising the steps of. 

downgampling the video stream to reduce the resolution of the video stream; 
encoding the downsampled video sn-eam to produce a base stream; 
decoding and upconverting the base stream to produce a reconstructed video 

stream; 
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subtracting the reconstructed video stream from the video stream to produce a 
residual stream; 

multiplying the residual stream by gain values so as to remove bits from the 
residual stream which represent areas of each frame which have little detail; and 
5 encoding the resulting residual stream and outputting an enhancement stream. 

19. The method for providing spatial scalable compression using adaptive content 

filtering of a video stream according to claim 18, further comprising the step of; 

analyzing the video stream and the reconstructed video stream to produoe the 
10 gain values of the content of each pixel in the frames of the received video streams. 

2Q. The method for providing spatial scalable compression using adaptive content 

filtering of a video stream according to claim 18, wherein the gain value goes toward zero for 
areas of little detail. 

IS 

21 . The method for providing spatial scalable compression using adaptive content 

filtering of a video stream according to claim 1 8, wherein me gain value goes toward one for 
edges and text areas. 

20 22. The method for providing spatial scalable compression using adaptive content 

filtering of a video stream according to claim 1 8, wherein the gain value is calculated for a 
group of pixels. 

23, The method for providing spatial scalable compression using adaptive content 
25 filtering of a video stream according to claim 1 8, further comprising the step of: 

combining the gain value with encoder statistics parameters from the 
enhancement encoder prior to the multiplying step. 

24. The method for providing spatial scalable compression using adaptive content 
30 filtering of a video stream according to claim 23, wherein the encoder statistics parameters 

indicate when the available bitrate budget is no longer sufficient for encoding at ftul 
resolution of sufficient quality, so that the gain of a first multiplier unit is set to a reduced 

resolution veiua in order to mcssi. the- available biircic budget. 
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25. A method for decoding compressed video information received in a base 

stream and an enhancement stream, comprising the steps of; 
decoding the base stream; 

upconverting the decoded base stream to increase the resolution of the 
5 decoded base stream; 

decoding the enhancement stream; 

multiplying the decoded enhancement stream by a sharpness control value, 
wherein the sharpness control value controls the trade-off between sharpness and the 
visibility of artifacts in the decoded enhancement stream; and 
10 combining the upconverted decoded base stream with the sharpness controlled 

enhancement stream to produce a video output 

26. a compressed data stream representing video information comprising: 

a base layer comprising an encoded bitstream having a relatively low 

15 resolution; 

a high resolution enhancement layer comprising a residual signal having a 
relatively high resolution, the residual signal being a difference between original frames and 
upscaled frames from the base layer, and wherein the residual signal has been attenuated. 

20 27. A storage medium on which a compressed data stream as claimed in claim 26 

has been stored. 
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ABSTRACT: 



A more efficient spatial scalable compression scheme using adaptive content 
filtering is disclosed. The amount of video compression of a spatial scalable compression 
scheme is increased by the introduction of a multiplier on the residual stream of the 
enhancement layer. The multiplier is controlled by gain values for each pixel or group of 
5 pixels in each frame of video from a picture analyzer, wherein the gain values tend toward 
zero for areas with little or no detail and tends toward one for edges and text. Thus, the 
multiplier acts as a filter to reduce the amount of bits spent on irrelevant data of the 
enhancement layer. The multiplier also allows dynamic resolution compression. 



10 Pig. 2 



PHNL02060B A A 022 28 • 06 -2002 "lo: 



2/6 




c& • j uii • cxsoc xw^a rnALir^ uxr ml. Ux mdJ £mjMUJ 



PHNL020608 £ 



023 28.06.2002 10:5 



3/6 



CM 

s 
§ 



2 



i 



§ 
I 



c= 







%££ 










S3 

-a. 


ll 




i L 



CM 



Ki- 



ev 



CD 

M 

S * 

LU 
CD 



I 



o 
cr 

Q> 



8 

CM 



5 

S_ CO 



CM 



I 1 



CO 
CO 



SI 



f 







3 









CO 

SI 



CO 

o 



Of 

d 



O S3 



M M 024 28.06.2002 10:59 

PHNL0206QB 



4/6 



226 



OUTPUT (FULL Q) 
228 



224 
J. 



220 

J_ 



-205 



dec 



base stream 



232 



— <^ 



dec 



enh stream 



sharpness control 
230 



222 



400 



reduced enh mpeg artefact level 



sharper 



FIG. 4 



PHNL020608 



• 



• 



025 28.06.2002 10:5 



5/6 



510 



211 212 



204 




BASE-ENCODER 201 



INPUT 

202 



1 




enc 





206 206 



rr 



+, 



2-nd ENH-ENCODER 



216 



511- 



eno 



base-stream 209 



210- 



t 



2-nd enh-stream 
1-st ENH-ENCODER 



214 f 218 



picture 
analyser 



I 



enc 



ir 



1-st enh-stream 
gain(x,y,fr#) V^. 503 



dynamic 
resolution 



OUTPUT of dynamic controlled video resolution 





228 



*226 



t 



-224 



dec 



•205 
base-stream 



-220 



dec 



1-st enh-stream 



-222 



OUTPUT transparent video resolution 



513 





1 




dec 


v 226 


*t 



-505 



base-stream 



^220 



dec 



1-st enh-stream 



r s -222 



FIG. 5 



dec 



2-nd enh-stream 



-512 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

^ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



